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Abstract — It is shown that the laws of thermodynamics are extremely robust 
under generalizations of the form of entropy. Using the Bregman-type relative entropy, 
the Clausius inequality is proved to be always valid. This implies that thermodynamics 
is highly universal and does not rule out consistent generalization of the maximum 
entropy method. 
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There is a consensus of a certain kind that among the physical laws those of 
thermodynamics are extremely universal and will persist. This optimism might have its 
origin in the fact that the thermodynamic principles have remained unchanged when the 
shift was made from classical statistical mechanics to quantum. This is indeed 
astonishing if one takes into account that the formulation of thermodynamics was 
completed in the 19th century, before the establishment of atomism in physics. Here, by 
the term "statistical mechanics", we refer to ordinary equilibrium statistical mechanics 
that describes normal systems, in which ergodicity is supposed to be well realized 
(though it still seems vague in quantum theory). 

Today, it is well known that there exist a number of systems in nature, which are 
essentially nonequilibrium and nonergodic, but exhibit definite statistical properties. In 
particular, nonequilibrium stationary states of complex systems are of primary interest 
in various branches of physical science. These systems are often characterized by 
nonexponential distributions including the power-law type. An important point here is 
that in many such systems the stationary states survive for very long periods of time, 
much longer than typical microscopic dynamical time scales. This makes it legitimate to 
suppose that such a state may maximize a certain statistical measure, which can be 
different from the Boltzmann-Gibbs entropy, in general. Here is a point, at which 
generalization of the ordinary maximum entropy method is expected to play a role. 

Now, the above-mentioned reasoning brings thermodynamics a new issue to be 
examined. That is, how robust the laws of thermodynamics are under such a 
generalization. The purpose of the present work is to answer this question. We execute 
it by employing the highly generalized entropic measure proposed recently and 
examining mainly the second law for the generalized maximum entropy method based 
on it. We shall see how the Clausius inequality is robust under such a generalization. 

There are several works devoted to highly generalized entropic measures in the 
literature [1-6]. Here, let us employ the one recently proposed in Ref. [5], which may be 
the most general form that is consistent with the maximum entropy condition. In the 
unit in which the Boltzmann constant is unity, it reads 
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S c iB] = -£ B(e, ) A(5(e,)) + 7][5] (1) 



with 



77[fi] = V f + (2) 



which can be rewritten as 



5 c [5] = -£ J" JxA(x) + c. (3) 

i 

In these equations, 5(£,) is a normalized and monotonically decreasing distribution 
function of which is the value of energy of the system in its z'th state. A(*) is a 
"generalized logarithm" satisfying A(^:)<0 and dA(x)/dx>0 for 0<x<l, 
and* A(.jc) — > (jc— >0+), making S G [B] nonnegative and concave (its further 
properties will be specified later), c is a constant, which ensures that S G [B Q ] = for a 
completely ordered state, B Q [£ j ] = 8 £ ^ with the "ground-state energy" e . This 
condition is necessary for the third law to hold. Note however that the third law is 
fundamentally concerned with quantum theory in the low temperature regime, whereas 
we are considering a classical system here. 

A generalized maximum entropy method, given the existence of a stationary 
distribution function, 5(£,), is formulated as follows: 



=0 (4) 



with 
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G = S c [B]-a^£ £(£,.) £,£(£,.) -t/j, (5) 

where a and j5 are Lagrange multipliers, and U denotes the average energy. The 
stationary solution to this problem is given by 

B(e i ) = E(-a-(3(£ i -U)), (6) 

where E(x) is a "generalized exponential", which is the inverse function of A(x): 

E(A(x)) = A(E(x)) = x. U denotes the average energy evaluated in the stationary 
state in Eq. (6) in a self -referential manner. In other words, A(x) in Eq. (1) is chosen 
so that it is the inverse function of the stationary distribution function, a in Eq. (6) can 
be eliminated as follows [7]. In addition to Eq. (4), we consistently impose the 
following condition: 



T 5(e ) — - — G 



= 0. (7) 

B-B 



Combining this with the normalization condition, 5(e ; ) = 1, we obtain 

a = -pP-r 1 [B], (8) 

where 

F = U-(3- l S c [B]. (9) 
On the other hand, /? is found to satisfy 

dS c [B] 



dU 



= P, (10) 
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which is actually nothing else than a generic feature in the variational problem in Eqs. 
(4) and (5) [8]. Thus, the thermodynamic Legendre transformation structure always 

exists, and accordingly F in Eq. (9) is regarded as the free energy in the stationary 
state. 

It should however be noticed that the zeroth law of thermodynamics does not hold in 
the present case, since it is not possible to divide the total system into two independent 
subsystems and the entropic measure is not additive, in general. This makes it hard to 
interpret f5~ l as a "temperature" (recall that the temperature specified by the zeroth law 
is an equilibrium temperature). Taking into account the physical properties of a 
nonequilibrium stationary state, it is natural to regard j6 _1 as a local temperature that 
may vary both spatially and temporally. 

The first law of thermodynamics reflects the conservation of energy and is therefore 
valid also in any nonequilibrium situation. Let us look at the definition of the internal 
energy in a generic state, 5(£,) 



tf = £M(e,.). (11) 

Change in a thermodynamics process is 

5t/ = £e,.5B(e,.) + £ B{ £l )8e,, (12) 

i i 

where 8B{e t ) implies the change of the functional form of 5(£,) whereas <>£, is the 
change of the energy due to a certain external influence. Identifying the quantity of heat 
and the work respectively as 

<5'£ = £ e^Bie,), (13) 
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<5'W = -£ B{e t )8e 



i > 



(14) 



we immediately obtain the first law of thermodynamics 



$Q = 8U + $W. 



(15) 



To ascertain that the above identifications are legitimate, let us consider a "quasi- 
reversible process" [9] connecting two stationary states that are infinitesimally distinct 
each other. Then, the change of S G is evaluated for the stationary state in Eq. (6) as 

follows: 



provided that the normalization condition on 5(£,) has been used. Therefore, we find 



This relation for a quasi-reversible process justifies the identifications mentioned above. 

Now let us proceed to study the second law of thermodynamics. For this purpose, we 
consider comparing a general distribution function, 5(e ; ), with the stationary state 

distribution function, 5(£,). In information theory, this can traditionally be done by 
making use of the Kullback-Leibler relative entropy (or, divergence) [10,11], which is 
intrinsically associated with the ordinary Boltzmann-Gibbs-Shannon entropic measure. 
However, it is a nontrivial problem in our case, since we are concerned with a highly 



<5S G =-£ A(fl(£ ( .))5fl(e,.) 



(16) 



dS G = pd'Q. 



(17) 
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generalized form of entropy in Eq. (1). 

For a solution to this problem, a clue may be found in the work in Ref. [7]. There, it 
is indicated that the relative entropy associated with the ordinary definition for 
expectation values is the one of the Bregman type [12] (see also Ref. [3]). In the present 
context, the relative entropy of this type reads 

B(e,) 

K G [B\\B] = Y, J dx[A(x)-A(B(£M (18) 

' B(£,) 

which can be recast in the form 

K C [B\\B] = S C [B]-S C [B] + PU-PU 

= /3AF (19) 

with 

A F = F - F = (U - S[B] I (5) - (U - S[B] I (5). (20) 

Therefore, one sees that the physical meaning of K C [B II B] is essentially the "free 
energy" difference. 

Let us recall some fundamental properties of K G [B l II B 2 ]. The following two are of 
importance for our discussion. One is positive semi-definiteness: that is, 
K c [B l \\B 2 ]>0 and K G [B l \\B 2 ] = iff B t (£,.) = B 2 (£,.). The other is its convexity 
with respect to the first argument: 

K G [XB,+(\-X)B 2 \\B 3 ]<AK G [B l II B 3 ] + (1 - X)K G [B 2 II B 3 ], (21) 
where VAe(0,l). 

Now, in connection with Eq. (18), take some arbitrary third state, B *, satisfying 
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K C [B*\\B]<K C [B\\B]. (22) 
Then, define the variation of the state 5(e, ) naturally as follows: 

8B( £i ) = {Afl * (e ; ) + (1 - A)5(e,)} - B( £i ). (23) 
Under this variation, the change of K C [B II B] with fixed #(£,) yields 

S B K c [B\\B] = Y,[MB(£ i ))-A(B(e i ))]SB(£ i ) 

i 

= £ A(fl(£,.))5fl(£ f ) + jS£ e ; <55(£,). (24) 

i i 

That is, 

8 B K G [B\\B] = -8S G + B8'Q. (25) 
From Eqs. (22) and (23), we see that the left-hand side of this equation is not positive: 
8 B K G [B\\E\ = K G [kB* +(1- k)B\\E\- K G [B\\B] 

= X [K G [B* \\B]-K c [B II 5]j < 0. (26) 

Consequently, we obtain the Clausius inequality 

PS'Q<SS G . (27) 

In conclusion, we have shown that the laws of thermodynamics remain 
fundamentally unchanged under generalizing the form of entropy in the maximum 



entropy method. In particular, the second law, expressed in the form of the Clausius 
inequality does not change for a very wide class of generalized entropies. Thus, 
thermodynamics is highly universal and does not rule out any effort for generalizing the 
form of entropy. 

* * * 
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